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(54) IMAGE PROCESSOR, IMAGE PROCESSING METHOD, PROGRAM AND 
STORAGE MEDIUM 

(57)Abstract: 

PROBLEM TO BE SOLVED: To photograph a still 
picture and moving pictures for several frames before 
and after the still picture so as to store the 
photographed still picture and moving pictures in 
associating with each other and to reproduce and 
display the photographed still picture and the moving 
pictures for several frames before and after the 
photographed still picture. 

SOLUTION: When no SW 113 is depressed, MPEG 
compression processing is executed for captured 
image data for one frame and the compressed data 
are temporarily stored in a buffer 107d. When the SW 
113 is depressed, JPEG compression processing is 
executed for captured image data for one frame, 
MPEG compression processing is executed for image data of next and succeeding 
frames, and the compressed data are appended to the tail end address of the buffer 107d 
to be stored. At the expiration of time, a JPEG file is created on the basis of data subjected 
to the JPEG compression, and an MPEG file is created on the basis of MPEG 
compression data for a plurality of frames stored in the buffer 107d. 
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Brjfefi^¥is{c<t ojg^^nfcSuia^ u-ASi^tD+j-A 

i:-r i. 2 {cie«cDia^ffis^eo 

[ii*«4 3 Etc, mtmmmy'-ii'(D^y\^-j^<o 

-^(D^yu~i.(Dmmcomm^^rs^\<ct-i:'mtm 

cii*S6] Etc, H5ia^i^^is{cj;t)jt^^nfc:7 

- ^ ^Bm-r 5 m±mEEm^m^m^ s <i t ^itia t -r 
?>mMm 1 TiiM 5 ov^-rn*^ i mcmm<ommmmmi 

fSo 

i:*)mmfEtxtcy\y-i.mm(Dmm'f—$'. 

-r;Hlif!(Dili^-r-^tc5htLT J P E GJEi^S^tf ^ Ji 

^^tm i: -r s if 6 {i:ie«<Dia»Mas«o 

fig-Ti.^ 1 (Dyr-fM'f^^mt. 

tatim^^micioi^^-iEnrzyL'-L.mmoDmm'f'- 
^t. mVi^h.^-^ j\'mm(om^7'—^<oyr^j\^m'^ 
mr^m2<Dyr^jli^^^mt^m^^ct^^mt 

■rswsRj* 1 ictimcom^mm^mo 

^ns^T'f-'UiMP EGyr^)\^-(:ib^ch^^mh 
[itsl^^ 1 0 ] MIB^ 1 (oyr^M'^m^mic J: t) 



fi)t?ni)7 7-r;HiM o t i o n-J P E GT'fe-SCfc 

fig^n^^r-Y^l/ti J Y'EQy7-()\^-Qtb^^h^^WL 
1 2 ] mifem 1 y 'j';l/fFB!t¥e, Rt/M 

n 1 (DyT-ciw^^^miciiKiV^^tn^mmcDyT^ 
Itiie^ 2 © :7 r ; Wfi!t¥^SJc J; 0 {tfiic^ tiS »ih 

Cli*« 133 MIC , Buf 2 <D 7 r I' 

«i}iam2©7T'l'yWfi)c^lStcJ:Df^fi!c?tl5-9-A 

tr\ mm-^if^iit^nmt-r^m^msnmi 20 
u>-rn*> 1 «tc8a«oiii«jQS^So 

1 4 3 Stc> tuias 1 (Dyr^^vV^^^mi^ 
20 J:»?{^fi)c$ti/c:7T'i';K tuia^ 2 cD7Ti';Htfi!c?ia 

ic^oi^^-^!nrcy7^)Vt<Dmm^fE.^i. tcmmy 7 

Htiaws:7 T ;vic <fc 0 > tiff 1 CD :7 T M'^is.^m 
izi:<DVf^-Stircy7-^jit. Huf am 2 o r -i" yi/^teSc 

mtt^^^msnm 1 1 (Dv^-rtiJb> 1 i^fcia^oMia 

153 MIC, ttia^ 1 07 r>f';Htfi!t#Slc 

<t 0 {tfiSt^ nfc 7 7-fjvt. mtim 2<oy r^)\y^m^ 

8 7!jM1 1 ©i/^-rn*M «tcfa«01i^5QSSMo 

iait-r?.iait#ia%«L, ttiiafait#gtciaii^n?.»i 
iii^x-^'07'-^'-9--rx7b\ MiaiaiS¥©oiati^« 

HfFfafiBH^ei*, failLTV>S7P-i»«©il!)iii«ix- 

- ^ ^fiss-r ^ct^^mt-r^ itsic^ 1 tcia^oiii^ 

40 ^{i^Bo 

[it«^i 7 3 tumxtt^mi. msmmm7'—s'% 
-^tait-ri.iai«¥S^^*> BuiatS)^¥is«. mrta+t- 
A^t^^-'na^A^^fig^ tifcti. wtaiaii^etcfati? n 
tzMm^^—^h. Huiams¥isic<tofi5^$tifc7b • 

MaWtT^§iS^t-5iii:;&1t^iii:-ri>W«3^l71jMl 6 

ov>-rn*> 1 «{cia«©iii^5aass, 

1 8 3, wimXf}^mtW^¥f-m.^m.f^ LT HU 
so lEidiii^x- ^^mti-t 5 }S##l8^^ty c i: m i: 
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■t^m^m 1 7bm i Ko^^-rni)^ i m^ctimo^m^mm 
mm^^mii. wmt£titzm>±m. ■^)-L.^-ffi'mm. 

Mf5il!)®oms:7U'-A<o-9-A^^><';i/ili«^f^fig 

M 2 2 (Di/^-rnA^ 1 m^mwL<Dmmvmmm.o 

■9-A:^.-r;l/iii«S{ci*;SLfc#±iHi: ^^ItihiiStc^fS-r 
{c J: O A:^.-r ;l/iii«tc Wis Lfc#±Iii i: ^ 



s 2 3 ov^-rn*^ 1 ^icfB«<oiii»fiaastio 

WIBA;/3XST' A:^) ^ nfci/jiS^v^- ^ emaotuiB 
B^^fB^t^^xiS^:■^i^^t^fcfiul^:7 ]y-Lm^<r>^L.^^ 

;Hi«%^«-r 5 ^- /m^^fiScXig i: . 
10 mJIBttia^T^-^'t, HafB^g^XST'^i^^t^/^:7^- 
AM^OBMS'x-^'t, MIB-9-A:^.-i';l/iii»^fiKXgT- 
^eSc^ ;mi«cD®^7^- a» B8a{\)- 

{.nam 2 6] SIC, tfrlBl!liii«7'-:S'©^7 l^-A 
tulBISSftXST'tt, BulBKliiijEEi^Xgtc J; ^ 7 A« 

20 [W#«2 7] Htc, tulBi!iiii^-x-^(D#7U'- A 

tfilBtS)i«Xg-e«, BtilBibiiiiBS/J^ffiiBlXStc J; § >' 

A«©ffas7^- ^ ^tsffl-r 5 c i: -r § 2 

5 tc|B«Oiii^5ail?^fe<. 

—LM^<Dmm'f—'i'. fjfB-9-A^--l';l/p^<Diii^f^— 
^ ^ff ifiS-r »±ilBE?ilxg^fii^ ?. c i: ^ItSi i: -r ^ 

30 ?4o 

{^fig-rs^ 1 cD^r-i'-'W'^figXSi:. 
ffilBJi^XSTie^^nft^ AiB«<Oiii®x— ^ 

^m^mz 5 (c|B«<Dili#5aS:^i*o 

mutm 3 0] tita^ 1 o 7 r /i/fteKxs, Rum 

IB^ 1 (d:7 r -I'yHtBgxigTf^^^ni.ii)®©:? T-r 

40 ;K iulB^2©7 7-i';Ht^X@Tf^fiic$n^ll±iii<D 

itm-m 3 1] Hic . BUB am 2 © :7 r -r /i/ftfigxgT- 

{±. Bt[8B^2cD7r-i';W'^fi!cXST'{^f£$n§-9-A^-r 
;l/Bi^®7 7'-r;Mc, aK-9-A^-i';i/iii«*{tfi!c-r5<D 
tcffli''Ac7 L'— Aiii^^!t#S-r i)-!! $g^{^ftn-r ^ c i: 
T% M3i-^lt§Ci:^1f^i:-rSli*«2 9Xt±3 0{C 

imi^m 3 2 ] S(c, BtUB^ 1 ©7 7 'T ;W^figXgT? 
50 {^^?nfc7 7-r;l/, «f|fB^2©7r-i';WtfigX@T'f^ 
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T'ftfiSc^ nfc 7 T ;i/ i: . mim 2 © 7 7 ^i/^^fiScxe 
2 9 tcf2«©ia^jas:^Sc 

3 3 ] Mfc, MfBm 1 ©7 T -f/HtBgXST- 
[at 3 5 ] mm^m^m'^^m-r 5 . < i: t 

1t?Si;-r5»*]S3 4 »ciB«<0iii#j(aS7?}*o 
[WsRJSse] tuiB«^xgT'«^;Jtxi>-9-A:t--<;i/ 

Mtc> HiliBi!ilii©m^7U-A©'9-i.^-r;Hffi«%f¥B!t 

-r -9- A ^^-r ;niig#fi!txs^fii^ , 

auiB«^XST{±ttflB-9-A^-i';H®®. MIBHia. M 
fB»Hi:«tc, tfifB-9-A^-Y;l/f^figXg-e{^fiR$nfc-9- 

fi^1-SiiJ^}i5^X3gi:, 

n;rc+)- A^-r Lfc0±iS i: 



m^m 3 8 ] m^m 2 5 Tis 3 7 tDv^-rn*^ 1 mic 

[ii^js 3 9 ] mn^m 3 s tc8B«o^a i^^mm 

L, 3^tfii-^5'*^»!*^^0Hltg^lBtij«{*o 
[0 0 0 1 3 

a^BSi/, iB^5aa:)?s, Mc/cyny^A. iB«iaE 
Co 0 0 2] 

V->Tt±. S^3>J PEG7*— T'y h^fflVfeibia 
[0 0 0 3] 

fc. v^v'^f;l':^3^^-ej£ffl^tlTV>;g)iB»;^xVT«. 

Fhiq^^') ^^£D^«^;<^U;^J-K*^^TfeO. IBS 
— >3 >J P E GJctSlbiUli^-eii, S^raof'— ^ 
[0 0 0 4] $/c. T'->*^;l/ef';j-;?j^^T'tiSS^Lfc: 

ti. »ihli7'-^'«7"-7'±, *fc«gUOfafilp«-r^T 

(cf^^^nSo •r-7'±{i:ll±i®A^IBa^ti§<t3^« 

tlS^^tcti, fBai;^7'^7*'«ii-*^tlTV^Sfci6x &t 

[0 0 0 5] *|gB^«t:i±<DP.gs{cs*^T^^nrcto 
[0 0 0 6] sfc. ^^B^ttMJc, mm-iEtxrcm±mt 
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So 

[0 0 0 7] 

[0 0 0 8] -r*t?-S, afi!e*I^7^-AiS^{cJ;oT 

[0 0 0 9] *SIB^(7)gW^31^-r5fcii){c. ^J;^{i* 
[0 0 10] -r^to-fe, ll*ihiiiRt;/X«i!)iii;&»±-r 

i: -r 5 B^^ia^eo 

[001 1 ] 

[0 0 12] [mi (Dmrnmrn] ^msmmviA. m± 

mmitMP EG 4EEm-T-^ tLx^mx'^^mmum 
[0 0 1 3] 0 1 ti. ^mmmmictsif^mmmmmm 

0 Hic p u i^^mmmmmw t^k>. ^^m^n&m 

^BORimiccOCFU 1 0 Ucj:0*JS|i$nSo CP 
U 1 0 1 icli. HihUin-T^-c-y^gpl 0 2. iSiSn- 

T'-fy^s^i 0 3. m^mm^ 104. 'ikj&ommy^ 

1 0 6, R AM (^>^*"AT^'-fe7.:?t^U) 10 7, -r 
— ^^i&^gPl 0 8. ^:/U'>y hny ha— 1 0 9, 
L C D 3 > h P— ;l/g|5 1 1 K iz+y^f— SWl 1 3, 

sij8ii^-p 114. mm^mfi&'r?>rztb<DD c/d c a 
>>'^-^'i 1 5, ^f-Yvi 1 7ft^^-n^^nsiigt^nTi^ 
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So 

[0 0 14] ^LT. iii^5aiig|5l 0 4JC{i;^j;^7gPl 
0 5x tS?ru>v hn^hP— ;l/gpi 0 9{ctt¥»*tS':r 
b>vhllO, LCDnvhP— ;l/gpi 1 HctiS^gP 

iT?Tti'7-m^am(om7f^mmt=?:(om.wi^) 1 1 2 

jb^Siic^nTl/^So $fc, DC/DC3>>'^-^ 1 1 5 
tc««?tel 1 6*^e>mjg3b^«*&?tlTV'5„ ^^gpi 1 

2 t^m^-^iyu-y hi 1 Oti> «^gPl I 2<D±mc 

mM^yi^y h 1 1 o-bmrn-intc-wwAtrji-DTis 
10 0, a^gpi 1 2icm^^^nx\^^^^^y'Cy^'f—^ 

[0 015] CPUlOl liR OM 1 0 6|^<D$IJ^7°P 

[00 16] • s^^fijigi? 1 0 4 A>p,tii;/3?nrci()iiit5 
^zfm±m<Dmmm»iE^^m39-^^^. r am i o 7^^ 

• RAMI 0 7J;OLCD3>bP— St? 

20 ^±Iii<Df^— ^;&DMAtejM-rs5as 

• iSfftSQiigp 1 0 4ti^^m^nztrzm^7'—'5'^3 p 
E GjEIBSfciiMP E GJEi^JaSLT, yr-fjim^r- 
■r-^+s«ftgp 1 0 A^^mt^mm 

• J p E GiEi!^. MPEG zm^m^^ijo r!zisbicB±m 

a-x-f >y ^'gp 1 0 2 . ttan— t'-C >y i'gP 1 0 3 %|g 

h 1 1 0 7b^6.A:^?n/-c'S^K:6eofc 
^ffl T 7° U ^ - v- 3 > con 

— >-w^-swi 1 4<DmmcWr>mm»3i'}F(om7fs 

30 • T -ir— 5/ 3 >*tT4'©SiJSi^-P 1 1 5 tCfc 5*J 

d^^, DC/D C:3>/S— ^r— 1 1 7lC^LTtti;^-r 

^fc. R AM 1 0 7«i®^MiaxUT 1 0 7 a. y-^ 
X'JT 1 0 7 VRAM 1 0 7 c, KjiS/^-y^r 1 0 
7 d. -^iljgx'JT 1 0 7 e :g:fif jlTV-'So iii«Mr»3 

xu T 1 0 7 a mmmm^ i o 4 * oasBse^ifcjStp) 
nr < ^m^mm (y u V7^>?^;Hi^) ^-r-^^i^iSfl 

40 gPl 0 8*^e>St*^ai^tlfcJ PEGiEaiil^T'-^, fc 

ffl^nso y-iJ'x'jT 1 0 7 btt, ^ST'piy^i^® 
fci6©y— ^x'jTT, c p u 1 0 1 T'^fT^ns^ffl 

RAMI 0 7c{iS^a5l 1 2^S5^-rS*Sx— 
^SiN^-rsVR AMtLTl^ffl^tiSo Kiii/^-y^r 1 0 
7d{*, idiEa— ri-y^'gPl OStctoTKiffiEEM^ 

50 nfc 7 u-L.'f—S'^m^mm^iEif-t^mci^m lt 
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*5<ffii|?T-fe§o tfc, -^iijgx'JT 1 0 7 eli^&a 

[0 0 17] -r-^^JflgPl 0 8«. iB«-T'-:S'^SIfix 
U7 1 0 8 a i:LTfiJffl$n. J P E CffiiSS^nfcS^ 

^SllftgPl 0 8 i:LT7^-y->zL;><^rUl±i^^^tl5A^ 

[0 0 18] Apt^gPl 0 5»±. L/>XSfx C CD. C 

C C D'sjS^-r^fci^tc^^lJicDUVX 
T':^fi!t^nT«3 0. CCD liU^Xm 

■rSfcJ6<0*^T$)?,o ^fc. C C Dnvha— ;bgl5 
a, C CDli:fe3^i'P>y<5'M#^i^^-y^-m^*«$& 

:^n^«^;& 1 0 tr y h v^i^^;bfl^tcS^-rSfcii)0 

[0 0 19] tfe. mmmmsai o 4i±. a^^sbi o 

>yi^a.^iiE^a3iii^Sas^tTU\ YUV (4:2:2) 
:7*— v-yh. fesvtiYUV (4:2:0) y:t~^ 

CO 0 2 0] ^±m=i~r^ yi^^l 02 a, 

1 0 5. mmmm^i 0 4lz^^rm^nrzm±m'r— 
PEGx>r3-^f ({tfig^n/cflitiiiT'-^SHi 7=^-^*8 
mmi0 8 ©iB»'r-^tS*flxU T 1 0 8 a (ctS^fi^n 
5) t. ii©#±iii=i— T'-c-yi^gpi 0 2fcJ:rpTJ P 
EGxvn-F^n, T'-^^SSflgpl 0 StctSSW^tiT 

§ m±m'f- ^ ^^im 0. j p e g w^mmiz ^ 
T Y \]W7'>^^jvm±m7'—$'^^Wi-r^rci6<D j p e 

[0 0 2 1] *fc. !!)®n-7^^'-;;^g|5 1 0 3 

7gi5i 0 5, iii^^Biaasi 0 4^cJ;»^^#e>nf^l!J^li•r— 
^f (YUV7='i?^f;Hii^7*-^') {C^^LTMP EGffifil 
^!!ia^m\ MP E GldiBT'— ^^ft^-r^fci6©MP 
EGxyn-^f ({t^^n/tKjSf^-^ti-T^-iJ'tSilftgp 
1 0 8CO®0x-^?^SS^XUT 1 0 8 afC*S«^^n§) 
i:. c©S!iili3— r-r-y^gpi 03{cj:oTMPEGx 

>3-K?n. x-^f^iwa5i 0 8{ciSi&«i^nTi.^.5K 

117='— ^'^SttSJO, MP E G#?iSttilfCJ;-X)TYU V 
T'v'^'^HliiiT'— ^'\^^-rSfci6©MP E G-xn — :Jf 

[0 0 2 2] ^zTU^y h3>'ha-;l/gpi O 9«, 
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t^'Zflyyh 1 1 0©|gij!j*r«ii:'-<>^J'>y^(cJ;i3^» 

m^^wsiX^xcv u 1 0 1 'Nfi^i-ri.fciixosij^^tT 

[0023] LCDn:/ h n— 1 1 1 {i, iii^jail 
gpi 0 4 3!)^P>g)M$nfcYU V-r->'^J;l/M#7'-^», 
avHix— ^f^Si&iigp 1 0 8 4'Oi®«7T'i';UcMbT J 
P EG*3J:t>'MP E G#?S;&#-pfcYU V-rv'^Jjyl/iii^ 
7^-^^§tt?i!?. RG Bx>^^;Hi^^^g5Lfc£.i: 
10 S^aiSl 1 Z^mti't^^'m.. V RAMI 0 

7 c{C+SiW$nTV>5RGBxS^^;V7*— ^f%|S|«fC« 

^gi5i 1 2'Nmt)-r^^ii^fTdo «^a5i i zitrn^ 

{CT:/U'!r— i/a ViftfF^CDG U I mmtOlUt}^ 
t>tl^o C<D«^a5ti2t:^SgJgJ8THiVG AMtS (6 4 

0 X 4 8 0 F-y h) T F Tm^m^^mt-r^o 

[0 0 2 4] '>-\'>y^'— SWl 13tt, meW}i^(Dmt>h 

20 ^Jg^fi.fciiOv'A' -y^?- T'feSo CCi/^-y^- S 
Wl 1 3{iX'l'>y^(0}fTaE(i:<fc-pT2SPgcOX-l'>y^ 
d< H >jb^* 0 , 1 lag <0.-K-:;'-> H > (^ffTBE-ti 

AElF«D;b;?<-5^SOa-y^i!j{WTfe>n. 2 
[0 0 2 5] SiJ8|14^-Pl 1 4ti. TT^U^-e/ 3:^11 

[0 0 2 6] Hitei 1 6i,tv^^—=^-^zrj\^(Dz^kWi& 
&^i.^li^m^T'$>^o ^fc:> DC/DCn^/^— 1 

1 5«, «iifii 1 6i3^^<DmmmB^^if. ms.. 

C P U 1 0 1 ^^ii>hir^^mi-K'Xi-mrs^ns.<omM.^ 
«*SLTI/>5o CCDDC/DCcnV/'?— ^ 1 ISttCP 
U 1 0 1 *^e)©*J8lHi#Jcj;0x &>5?<Dmffi©«*&OPjg 

40 [0 0 2 7] 1 1 7 ci. Ki®»K^M*ti-s<J-r 
5feii>to-e3&'3, ^f'l'v-ffi^-b-y hLfc^eid-rs 

-fey Fbfc^-fv-fiitc 

^§i:^-i'^7-y/fi#*^c pu 1 0 i{ce^p>n?.o 
[0 0 2 8] i:4±®^fiK^fii;^5*llfiSJB«(c*3it5il 

m^w^moMV?^. 0 2 tc^-rpjao7 n— f--^'— f 

CO 0 2 9] lRl0fc:j3l/'>-C, Xx>y:/S 2 0 1 T***:© 
so «Jl*<JSA^ni.i:, T.T'^yifS 2 0 2{CfeV>Ts 3gffi 



(7) 



2003-92724 



11 

^ihiii^, mmmv^-'S'co^^i&m^mn-r^. cos 

2 0 2fc*3VT|f±^:-KT'*i/^«^t(ii!ia%X-r'y 

So 7.x-y:rs 2 0 4fc*3V^Tti^^— FT'«* 

V>*i^tct±5[ia*X-r«y7'S 2 0 eicm^L. Xx-v^ 
S 2 0 6fC*3V^T. ^<Dfi6<DSaSA^*tT?nSo ^ofte 

[0 0 3 0] X7^>y:/S 2 0 3. S 2 0 5. S 2 0 6© 

"tn^etiommtrnTt^t. x-r-^^ys 2 o 7{c*5v^ 

>y:^S 2 0 8tC*5l/^T. aiHOF FjailAWf ^tl^o 
Sfc, mOF FjS{'FT'^:V;'«-&tC«. *-K^t)#x. 

2 0 2 K*-- if 3 A-"©^! ^'JaS'xMSc 

[0 0 3 1] '^(C. ±a!(DXf--y7'S 2 0 3{C3ot^-?)^ 

±iii. i^)IiiS^^ail<DPi^ffl^i^^B^*0 3*ffl^^TJ^^T. 
mm-t^c 03«, X'r>y:rs 2 0 3fc*3it§5aaoi¥ 

[0 0 3 2] |pl0{C*5V>T^-f, Xr-y-fS 3 0 1 T% 

^^)\/^'<X (8 0 X 6 0 d o t ) ^<DWi'\^^i^^fr 

[0 0 3 3] ;t'^U'-^-{cJ:^ili^(DSS?Smi> « 
S^gPl 1 2t—mci3:-:>X\^^%>^yi^yhl 1 OfcMt" 
5-?>«l{ttc i -p Tii^* tlfc K) . *Jffl^-Sf 1 1 4 

7"-y:/s 3 0 2tct3V^T. -y-A^f ;Hi^A^SW^txfc: 
X7^"y:^S 3 0 3tC*5i/''T, S*3^nfc-9-A 
^-fyl/ffi^tc^^JtS-r ^Kil-r- A^#& L TV ^ A> i: 3 

{ifSxEfSo ibil^A^#aLTv^?.Jl^(i:i±Saii;£:Xx 

[0 0 3 4] X7^-y:/S 3 0 4fCfcV>T{i^-r, 

Hitiii^— r-f-y^gUl 0 2tcJ:t) J PEGffiliiaa 
U #3i$tlfci*lhiii7'-^f%QVG A-y-'TX (3 2 0 
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X 2 4 0 d o t ) ^clSS'J^^aa^^7ofc^i«^^^T3o ^ 
e)tcx-r>yys 3 0 sfciov^T, msim.m^ntc^±M 

mb. tl!)iii3-7^-i'-y^g|5l 0 3lcJ:^MPEG#^5a 
SAWT^n. ^ e.tCQQVG A-y-WX (1 60 X 1 2 

od o t) ^ci^/J^^as^^Tcfc^. RBw^jaaA^Tt) 
ffiT'is]B#tctT*:)ni)'toT'fei>o dtife^oa^^ytcov 

10 [0 0 3 5] CCT, Xx>yyS 3 0 6fCfeV^Tx 

^^-jtf'Ftc i o TJM^^ tifc^^tctiJaS^Xx >v ■/ S 
3 0 7{Ci^fT-r5o 7.y-v-:fS 3 0 7 T'ti. CCD^ihBi 
t'-^^ V G A-9--l'X-l?i®S±«^lc«^ft^tTt>n5o ^ 
fc. IHHttc, X-r>y:/S 3 0 8lc*5l>T, S^StlTl^ 

t) VG A-9--i'X-ei®®^f*tcs^a5^A^tTt>n5o 

x-f -yys 3 1 OKfeVT, 3 0 7, 

S 3 0 8tCi3lt^S5fe«^CD4^ffiT's C£DaB*^^i^:5' 
20 >;xg^$ni.i. HO'XT^-yyS 3 0 4J-:iI^©#ihili. K 
HicDlll^S^iiiffico^aa^M;^, $?-c, XT^-y^S 3 1 

rstEtitc^-^lcit. WO*X-r-yrs 3 0 1 o:)-*)-L.^^}V 

[0 0 3 6] $fc. X7"«y:/S 3 0 SlCfclz-'T. 

li> Xt^'vT'SS 1 2JC*3V^T, m^fEtxTcmmcfti^^ 
•t^m±m'f—$'^'f-^^mS^l 0 8A^88ti5^aJL. 
^±jffi3— x-r >y ^'35 1 0 2 fc is J P E G#?gffia*'« 

30 ii?T?n, #?isnfeii±jax-^%vG A-»?-^x (e 

40x480dot) T'iiiS^#{cS5^A'^fft>n^o ^ 

3 0 1 O-y-A^^-r^l/ia^-r— ^ftO— MSS^'nMSo 
[0 0 3 7] ^/t. Xx<yys 3 0 21C*3</^T, H^O 
jMS?A'<tTt3n^A^ofc«^(C«> X5^-yys 3 1 4tC*3 

y^WTtstlfc^^tCti, X7^«y:rS3 1 5lc^ 

[0 0 3 8] ^{C. ±32li<DX-x<yys 2 0 5tCt5ttS» 

[0 0 3 9] [lI^tCfcV^T, X-r>yyS 4 0 1 Tli, ^ 
^— H (Om'^ic It. X7^"y:rS402 

m±mmB't- V t\^^o c tx\ xx-y^s 4 1 etii^ 
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[0 0 4 0] mmmmmmxHi. t.-f7,7--yfs 402 
tcfev^T. A^^gpi 0 sis'^mm^m.ui 0 4*111; 

R A M 1 0 7 <Dmmmm:r.V T 1 0 7 a fc^ 0 jitJ 

saa^tf e>o -^icxx-vys 4 0 siasi^x. 

^ — ji^*^* * nfc*^ H 3 *\ f? 5^ ■\' -y — s w 1 

1 SA^Jf^tlfc (i'-VV^'— SWl 1 3A^->-t-v^ — O 

il-^tcli, X-r-'VT'S 4 0 4 tC*3l/^T^ Xx yrS4 0 
2T'^^)3A^/c 1 7^-A^cDiiiiST'-^tC)t>fbT. K 
jiin— r-i'>y^gpi 0 StCt-^TMP E GjESIJaSA^II 

?T*ti, MPEGEE>^^nfcl7^-i^^©x-^'«^ 

Xy-^yys 4 0 5tC*3V>T. Kiii-'^-y :7 r 1 0 7 d-^— 
^WlctSSfl^tT^o mm^'iyyy i O 7 dt4'J>^>'^>y 
^rtftoT^SO. SilTbV^l^— AOMP EGSEfiST^- 
[0 0 4 1 ] Sfc. 7.y^yfS 4 0 3{Ct5V^T, 
^ + -Jg^A^^^nfc«^(c{±, XT^-yT'S 4 0 6tc^3 

0 2T5?*)iiA.ff 1 :7^-A^Ojii«x— ^f{C«LT, 

m±m=i—7'^ •y^'gPl 0 2{C<J:oTJ P EGjEiSSffiS 
if^mn-^n^o '^tcX-T^-y^S 4 0 7(cfca>T. ^PbW 
jflijo^ciitctjf-rv— 1 1 7lc^''f x'— (a (Wiiiiai^^ 
H) *-b-yhU ^-fT-i 1 7*X^-h$i*5^(aS 

^v^*'«fi^j^ti\ »r#^-sf 1 1 4tc$sni> rfe:fej to 

(i^g^^l 1 2tc*^SnTV'>5) , >*S4^— ^JfTf 

[0 0 4 2] X-r<yys 4 0 8T'«. T-x-y^S 4 0 2 
i:|5l«lC, 0 5ipP>mmmm^l 0 4*iiC 

XmtSfEn^ 1 ^U—A^^OYU V7'i^^;Viii§fex-^' 
R AM 1 0 7©iii#Jgr»iJ:'JT 1 0 7 atClSJtJjity 
SaS^tTPo $e)tcx-r>y:/S 4 0 9(C*3V^T^ X-r>y 

■:fs 40 4tmmc^ ;^7"-y:/s 4 0 8Ti{tJiiA,fci 

7 Lx-A^©iii#-r^-^fci* LT> iftiSn-T'-r' y 

1 0 3{cioTMP E GJESl^^,s*'«*^T^n?)<, mpe 

GEiSS^nfc: iyU-L.^(D7'-'$tli. Xx-y:/S 4 1 
Ofcfet->T, WjiBA-y^r i 0 7 d ©gmS'viiiPtSiffl 
?nSo •f-n*^€)X-r*yys 4 1 i{cj3V>T, T.'fyf 
S 4 0 7T'e®!jLfc:^-r-7- 1 1 7*^^-r AT-y^Lfc 
A>H 3 *>*f-i >y ^ U ^fc^-r AT -y T'LTl/^^&t/^^ 

BtfX-T'yT'S 4 0 8'^M»)^ 7 Ix— At^-^^^M P E 
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GEiSS5as*i^»3ig-r. 

[0 0 4 3] X-r>yr S 4 1 1 iCfcU^T^-Yv— 1 1 7 
*^^-rAT<y7'Lfc^-&tC{i. Xy-^fS 4 1 2lC^3V> 
T, t-fx 7>-r-yys 4 0 6T'J P EGffi^Stlfc-r— 
^'IC^^LT. m^cOJ P EG'N-y^*^t*(Dx-^f*{vriP 
U J P EG7r'l';l/i:LTil^x-^^Si?ftJiUT 1 0 

8 a{c«#-r5ias%iif7-rso raNftcxT^-yT's 4 1 
iSS'J^®il*^TV^. ^ p, J p E G s.m9mic j: a^^ 

xmmr'—^'it&t^^iVT 1 0 8 atuffi^f «o 7. 
T-'^XS 4 1 4 tC:feV^T, Xx>y:/S 4 0 5. S 4 1 0 

^c^3v^T^s^«^nTv^i.^tl^^7^-A<DMP E ge^t" 

— ^ftCjtbT, mSOMP EG^-y;Sf— ^H<Ox— 
f^tilDU MPEG77"r;bi:LTiiI«7'-^'*&»jX'JT 

1 0 8 a{ci5H«fcf«i^f ^5[^s%^^T■ri.o cneoj 

PEG^r'f';!/, MP E G77'-r'>'Wi|S|U7y-i';l'ife 
T% ffi3i?*<?-n^n r. j pcj r. mp4j tvx 
{s#«nSo ixto^o^WMowinKJzo. j peg 

20 ^lhili7 7"f';l'fc^<Dlut^«DffiStD^^OMP E Gib® 

yr^fi^tLx. mn^yT-ffi^^xmmitif^tixi'f^ 

[0 0 4 4] ^fc. •9-A:t--i';l/-r— :>{c«. Vf^-t^(0 
X-r-y^S 3 0 3 tci3V>T-9-A:^'f ;l/iail!%SS? 

tb<{i^<D#acD5=-a:-y^'%tT3^lc«c:©a:3 
[0 0 4 5] ^n*>?). 4 1 5 iCtJV^T. * 

iffiffitc r;;{-('>'iaSJcMi>J T-Yn^^r^lt, COT-T 

40 0 2 , y ix— A-r— ^ ©gt^5^3ii5*5aa*^sa*pajis 

[0 0 4 6] — 7?, X7^'y:^S 4 0 1 {C^SV^TldHJii^ 

KT^&V^Jl^, X7^'yyS4 1 6{c33l/->Tv 

95 1 0 5*>p>ii^5asgi5i 0 4%ai;Tai:'3$n^Yu 

V7'-:^^;l/B«i-r-;J'*, 3ijBcWlc«^gP 1 1 2^^111:^1 

t^fm.m'i^n. m^f^^-yr-fy^r-ui^^w^ 

0*»j'>^-y^— SWl 1 3 Jb^Jf ^niTc (S^-vy^— S 
50 Wl 1 Si^i^-v-y^f— ON^j^i^i'aXDtt^ 



(9) 



!ttF»fl 2 0 0 3 - 9 2 7 2 4 



15 

^-jiQS*^fft>tl5o OSO, i'^-y^'— SWl 1 3*^ 

^T^tirm^x-m^^^i i 2t«^^nTv^;5 i yu 

-ACDBftT^-^ ^ RAMI 07 Oil^Jgr^ai U T 1 0 
7 atJ:^S*fl-r?)5£iil*^*^T^n-i)o ij^^lcXx-y^S 4 1 
9fc*5V>T, ili«JgPl3:UT 1 0 7 a tlSlft^tXTV-'S 

io2fcj;oTjPEG a^5ag*^*tT^n-5<, J P E 

G^m-^ntc 1 ^U— A^i'O-r-^'ti:. Xt^-^^S 4 2 

•y^s 4 2 1 (cfct^Tx ^nfcSllhs■x— 
^^{cJttLTaS'J^^^la^^fv^ $e>lcj PEGffiSiJagic 
J;S-9-A^-r-»l/T^-^f ©ftfiK*fi=v\ IrI«I(c J P E G 7 
T^;l/i:LTiii^-r-^*SiN^a:';T 1 0 8 a{c{S#-r 

r^}v^(omm^^i^-r?>o ^lt. T.^r^yys 422 

-&fc«, X-r>y:/S 4 1 e^MO. lia.— 7 T-T > 
[0 0 4 7] msit^ T.'r-j-fS 3 0 1 
?)o iRlEtc^fiiiffiliS^gp 1 1 2tcS^;^n^o CCD 

0. 80x60dot tDSS/hiil^CD J P E GJESS-r— ^ 
[0 0 4 8] |5lSti:*5V>T> 5 0 1 \,t^ 

A^«^^nsffiiieT% ^>f^iii03b^i!iiii-r-3'^ltoc:i: 
5 0 4*'«MfeTa^^tlTl/^5o L*^L> 

[0 0 4 9] -^tti^ 5 0 3«P±H-r— ^O^Ot'— ^ 

^ o*> if ^ fc5|9J»r-r S c: i: *^T' ^ 5 o 

[0 0 5 0] 5 0 5 »ilti**'r;biiiM^x— ©o-fco*^ 



16 

4 {c^*ns±TSti*-y;i/^-^si{'f-r ?. c t tc J: 

[0 0 5 1] 5 0 6. 5 0 7{i^n^n±TXi7a— ;l/ 

^ y ^ .y ^-r 5 i: -y- A^-r ;l/ili«!-K*^±X a -;K 

^ n — ;l/-r 5 1) OT- S o 
[0052] 508 \t%m.^-^ >T-^::i >T'fe 

20 So 

[0 0 5 3] 0 ^ 5 A^-r^l/iii^ 

A^-Y;l/iii^*^M»?*n/-cil-&©iiiffi«5^^J^at3-ro 
[0 0 5 4] |oliatc:^l,^T6 0 1 tilllhiiiS^ffii^'^\ 

ss??nrc-9-A:^.-r;bis«fc*ffS-rsi^±iii«-x-^'* 

t/\ QVG A+f-rX (3 20x240dot) T'CO^ 
mcm^t^o Sfc. 6 0 2lifllJiiii^-r'— ^5rtc^js-r 

^mmm'f-^^m^mh. up e G#?i5aa%^Tofc 

?ft$S/hJail^m\ QQVGA1t-rX (1 60x 1 20 

dot) •vc(ommcmmmcwmn^^m^n^o 

[0055] 603 « TMSJ :nZ/<Dm^mi$.-V& 
0> ccDT-i'n^^'^^^-y^-r SC i:{cj:0. 05O 
•9-A:^'f';U— M^S^'NMi.o Sfc. 6 0 4 tiW^-K^^ 

-rsciitciO. Iftiiilf^A^x^-h-rSo *e>(c, 6 

So 

[0 0 5 6] C <DiiiffiK:*3V''T. ^±m^^W^6 0 1 
;gr^>^.y5^f Si:. VG A-tt-YX (6 4 0 X 4 8 0 d 
ot) -eifflffiV'>t7lfv>tc»±jii-r— ^Jf^^a^^tiSo * 
fc. «iiii*S^^i^6 0 2%'^>^>y^-rsi:, **te® 
? tXT S l!liii-9--r XT'lfi® -x- ^ ? tl S o 

[0 0 5 7] ^USSJ^Hg-eti. Il±iii fcLTJPEGjE 
^{CJ:St'->*^';1/7'-^s ffijStLTMP eg 4ff^{C 
J:S7'>'^';l/-r-5f*«UtcfeiflttWbfc*\ fte©a>JJ: 
so Bii, ibiBffi^:i?S, feSt^{ilfff«StcJ:S7*-^J*)pJffl 



(10) 



ItBB 2003-92724 



17 

{fx m±mtLXli. RG Blf hv>;;7'-r-i5». GI 
Fffi^x-^', P I NG£EIBSx-^'%H^a7*--7<y 

EGK MP E G ZSai-r-^^ift-g-^nSo 
[0 0 5 8] 5 6lc*||SgJgSgT'«> ryjy-v'ai^ 

[0 0 5 9] [^2 (Dmmmm] m i (ommmmn. m 

OffiaSP^iCi: LT J P E G J: 0 tffSS^Oi«l/^M PEG 

[0 0 6 0] 0 7{i, 2|s:^SgJgffi(c*5lt5^±iii. MB 

[0 0 6 1] lRl0tCi3V^TX-r>y7'S 7 0 1 s S70 
2. S 7 0 aii^-e?, S 4 0 1 , S 4 0 2. S 

4 0 3 i^lWlCiaiiT'fe^o ^-LT. Xx-y 7" S 7 0 3 fC 

7 0 7JL:^^(DMS^jityo Sfc ^-^f^j-^-nm 

1S^1i.\^^'^\Z.\,t. ;^7^-y'rS 7 0 4fCfeV->T. X-r-yT" 

5 7 0 2T'«f0jiA.fc 1 :7^-A:a-(r)ia#7'— ^tc^^L 
T, SS'hi!aS^tTV\ QgYGMt-fX (160x12 

0 d o t) ois^s-r-^f'x^gi-rsMa^iitT-rso ^• 

LTXx-y::^S 7 0 5tcfeV>T, iB|/h?nfci®«-r— ^ 
tc^^LT. Slihiiin— -y ^gp l 0 2 {^.t-^T J P E 

G£E*itoa*WT?n§o J p E Gsas^nfc i -7 u- 

7r 1 0 7 d'N-^ftKclSiS^^n^o 
[0 0 6 2] $^c. X7^-y:/S 7 0 3{C*5V^T, 4^-^^ 

^-v'-Jis^^^^^n/tig-a-tcti, XT--y:/s 7 o 7 tc*3 

0 2 T'?^t)^A^r£ 1 7 u-A^)-<DiH«'r-^ji:i*LT, 

T^^- >v^gi5 1 0 2lcJ:oT J P E GEiSSSaa 
A^T^tlSo '>JfcX-r>yys 7 0 Stc^l^T, NfF^lt 
lB!j©fc46t^'rv- 1 1 7fC^'rv-ffi 
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[0 0 6 3] XT^-y^S 7 0 9T-{i. T^y-^j^S 7 0 2 
t|5|«lC. :«7^^gi5l 0 5*-e.li^«iag|5l 0 4%ac 

R AM 1 0 7(Djii^Mr»lJ:UT 1 0 7 atCffilOiitJ 
*aa^?79o ^e){CX'r-yyS 7 1 0{c:6V>T> X7^>y 
:/S 7 0 4 tISIIttC. Xx'y:/S 7 0 gT-IXOii/uff 1 

y u-L.^comm'f -■$'izni.T. m'hmm^'<ji\ q 

QVG A-y-'i'X (160xl20dot) tOSi^T^— ^ 
10 'sS^f ^toS^lltf-r^o ^LTX-r>yyS7 1 lie 

^'•yi'gpi03(cJ:oTJPEG EESISttilA^llfT^n. 
J PEGJEi^^tlfciyU— A^J'Ot*— ^fi. T^f-yf 
S 7 1 2fct3l/^T. ibli/^'y^T' 1 0 7 dcDS^SM^ii 
SP^S«fi?tlSo iE-tlft>^X-r-y:/S 7 1 3tcfel,->T, X 
■r-yys 7 0 ST'gtfjLfc^fi'T— 1 nif^^-^KT-y 
T'bfcjb^ifdA^^^x^y^L, ^/-c^-^'AT>yyLTV^ 

tcti. StfXT^-y^S 7 0 9^M0, 7b— A-r^— ^'O 

20 J P EGJEEifiS^aa^Sri^Oii-ro 

[0 0 6 4] X7^>yys 7 1 3 (Ct3V^T^i-r "v'- 1 1 7 
*'<^?-l'Ay'y7'L^c*i-&lC{±, X-r>y:/S7 1 4fcfeV> 
T. S-r^ XT--y:/S 7 0 7-ej P EGffiRS^tlfc7=^— 
^IC^LT. m^<DJ P E G^-y:?*— 
AdL. J P EG7r-Y;l'iLTiii^7^-^+SJfl:LU7' 1 

0 8 aicu^-r:s>mm^mn-t^o lai^tc^^:/^^— 

y-^y'-fSl 1 5{C*5V^T. J P E GffiiBIJaS{c<i;§-9-A 

30 r 1 0 8 aicU^tEtl^o ^AlC^ Xx-yT'S 7 1 6 1^*3 

l/^T. Xx-y:/S 7 0 6. S 7 1 2 ^^:^3V^T^S^^tlT 
V>^^8!l7U'-AcDJ P E GEEi^x-tJ'tC^^LT, rIt^ 
<0J P E G'N-yiJj'— ^7T-l';l/7*— -7-y h{CM-ri>7^ 
— ^»*if*^»|-i)PL. Mo t i o n-J PEG (ttTM- 
J PEGilOf^) yT-^J\ytLrmm'r-'$ii^m:3^VT 

10 8a icmmicu^-r^UBM^mi-r^o cne.© j 

? EGy t^jW M- J P E G^r'l'^MiraC^r-Y;!/ 

S£5i^*^^-n-rn r. j pgj r. mj pgj t 

40 £DJ P E Gll±iii7Tl';L'i:^<0ftiIt*©ttiit©^P^OM 
-J P E G«Jlii7 7"l';l/fcLT, raU7 7f;U«-PMa 

[0 0 6 5] ^fc^ i(D*SgJgffii:|5i«{c, -y-A^-T;!/ 

-^<Dy7^}i'^(omm^it1sar^o cojc^ic-rsc: 

50 *'«S*'>©f-x-yi'*tf'5<li:*^T*^5o 
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[0 0 6 6] ^nA^P>. X'ryZfSl 1 TJctSV^T, 7. 

[0 0 6 7] ;^xy:/S7 0 1 ©16iSffi^^:-K<D^x 

§o ^aSOrtSti, XT'-y/S 4 1 6~S 4 2 2 tlS)^ 
[0068] [^3 (Ommmm] **fiSJSfflT'«, giJI^ 

[0 0 6 9] 08{±, Xx«y::/'S3 1 5 JCfettSgiJ^® 

•y^^-rSo ^x>y^-r5?Jffii:LT«mi©^Sfi)^^T 

t »i0^ L <t 3 . tiS L fc-<t A ^L't'- icUtU ^ 

r-r;!/^ (DKiii^-r'- ^ A^#ite-r § ^ <y 

So 

[0 0 7 0] WiliT^— ^?A^#ffiL.fc«-&. X-x-yyS8 
0 2(ct3V^T, gim*-K<D^S?;<^i— a^^fTdo 

Tgij^-rsid* r^gij^^—Kj . i3it;»jiii7'-4f 

(Ds^^nm-r^^drj: rmmnm'e—h'A cd2o©^— 

C CT% Xx-y :r S 8 0 3 fCfeV^T, ^BiM^— K*^S 

■r s ■9- Aj^.'T ^ tcfif in? tifcl^ffi loil^fcBim 

[0 0 7 1] XT^-y^S 8 0 SlCfcV^T. ^iUI^*— H 
*^S*?^ti:&3b-'o/c«^tcl4, XT^-yT'S 8 0 6^^:t3V^ 

SR^tlfc^^tcfi. X-T--yyS 8 0 7(c*5(/^T, 

x-r-y:^s 8 0 4 hmm\cmm'f—^yr^)V(DfimM 
mis^m=izti. saii%)^7-rso xx>yy^s8o 

X-f-y^S 8 0 8tc*;i/^T. iij^4^-v 
tTt)n/-c*^ i: 3 A^^^ i -y ^ L. ^ ^ ly-H/VmiWrt) 

T.'r y-fS 8 0 1 fC*3l/^T> WlHx— 
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:&3{)->o/c«-&tCl4. XT^-y^S 8 0 5(Ct3V>T, 

■rso 

[00 7 2] [^4aD*«iJBS] ^171jS3<D^i5gJ^^ 
T'«, 0 5 T'^L/-c-9-A;^-<;l/iii^7='-^»0-M«^ic 
feVTli, ^iBT'— ^'{cJ*-rs-9-A:^i';l/B»<D**^ 
-M^^^tlSfftJT&o fco 

[0 0 7 3] *^)5SJgft|T'l±. •y-A:t>l';l/jl^-M«^ 

10 — AcD-9-A*-i';l'il^3!)^|iI^fc— Ma^^tiSJ:^:^!! 

fii^J^«{cov^Ti^^B^■rso 

[00 7 4] 09{i. ^^SSmitCjiS^ -y-A^^-Y;!/® 
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* NOTICES * 

Japan Patent OfBce is not responsible for any 
damages caused by the use of this translation. 

1. This document has been translated by computer. So the translation may not reflect 
the original precisely. 

2 **** shows the word which can not be translated. 
3. In the drawings, any words are not translated. 



CLAIMS 



[Claim(s)] 

[Claim l] An image processing system characterized by providing the following. An 
input means to input dynamic-image data constituted with a continuous frame image A 
directions means to direct said desired frame image from dynamic-image data inputted 
by said input means A thumbnail image generation means to generate a thumbnail 
image of said frame image directed by said directions means A storing means to 
associate said dynamic-image data, image data of a frame image directed by said 
directions means, and image data of a thumbnail image generated by said thumbnail 
image generation means, respectively, and to store them 

[Claim 2] Furthermore, it is the image processing system according to claim 1 
characterized by storing compressed data for every frame having an animation 
compression means to compress each frame of said dynamic-image data, and according 
[ said storing means ] to said animation compression means. 

[Claim 3] Said animation compression means is an image processing system according 
to claim 2 characterized by performing MPEG compression processing to each frame of 
dynamic-image image data. 

[Claim 4] Furthermore, it is the image processing system according to claim 1 
characterized by storing compressed data for every frame having an animation cutback 
compression means which reduces size of each frame of said dynamic-image data, and 
compresses to each reduced frame, and according [ said storing means 1 to said 
animation cutback compression means. . 

[Claim 5] Said animation cutback compression means is an image processing system 
according to claim 4 characterized by reducing size of the image concerned and 
performing JPEG compression processing to each reduced frame by thinning out the 
number of pixels of an image of each frame of said dynamic-image data. 
[Claim 6] Furthermore, an image processing system given in claim 1 characterized by 
having a still picture compression means to compress image data of a frame image 
directed by said directions means, and image data of said thumbnail image thru/or any 
1 term of 5. 
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[Claim 7] Said still picture compression means is an image processing system according 
to claim 6 characterized by performing JPEG compression to image data of a frame 
image directed by said directions means, and image data of said thumbnail image. 
[Claim 8] Furthermore, an image processing system according to claim 1 characterized 
by having the 2nd file creation means which creates a file of image data of a firame 
image directed by the 1st file creation means and said directions means which creates a 
file of said dynamic-image data, and image data of said thumbnail image. 
[Claim 9] A file created by said 1st file creation means is an image processing system 
according to claim 8 characterized by being an MPEG file. 

[Claim 10] A file created by said 1st file creation means is an image processing system 
according to claim 8 characterized by being Motion- JPEG. 

[Claim 1 1] A file created by said 2nd file creation means is an image processing system 
according to claim 8 characterized by being a JPEG file. 

[Claim 12] Said 1st file creation means and said 2nd file creation means are an image 
processing system given in claim 8 which is attaching the same file name to a file of an 
animation created by said 1st file creation means, and a file of a still picture created by 
said 2nd file creation means, and is characterized by relating thru/or any 1 term of 11. 
[Claim 13] Furthermore, said 2nd file creation means is an image processing system 
given in claim 8 which is adding information which specifies a frame image used for 
creating the thumbnail image concerned as a file of a thumbnail image created by said 
2nd file creation means, and is characterized by relating thru/or any 1 term of 12. 
[Claim 14] Furthermore, the image processing system of the publication by claim 8 
characterized by to associate the file which was equipped with a management 
file-creation means create a file created by said 1st file-creation means, and a 
management file which described relation with a file created by said 2nd file-creation 
means, and was created by said management file with said 1st file-creation means, and 
the file which were created by said 2nd file-creation means thru/or any 1 term of 11. 
[Claim 15] Furthermore, an image processing system given in claim 8 characterized by 
having a multiplexing means which multiplexes a file created by said 1st file creation 
means, and a file created by said 2nd file creation means, and is made one file thru/or 
any 1 term of 11. 

[Claim 16] It is the image processing system according to claim 1 characterized by for 
said storage means to cancel data of a fi-ame in old order of timing memorized among 
dynamic-image data for every memorized firame when data size of dynamic- image data 
which has a storage means store dynamic-image data temporarily for said input means, 
and is memorized by said storage means exceeds storage capacity of said storage means. 
[Claim 17] Said input means includes a storage means to store said dynamic-image data 
temporarily. Said storing means Dynamic-image data memorized by said storage means 
after said thumbnail image was generated, An image processing system given in claim 1 
characterized by associating image data of a firame image directed by said directions 
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means, and image data of a thumbnail image generated by said thumbnail image 
generation means, respectively, and storing them thru/or any 1 term of 16. 
[Claim 18] Said input means is an image processing system given in claim 1 
characterized by including an image pick-up means to picturize a photographic subject 
image and to output said dynamic-image data thru/or any 1 term of 17. 
[Claim 19] It is the image processing system which is equipped with the following and 
characterized by said display means carrying out the repeat display of the animation 
concerned when an animation corresponding to the still picture concerned is stored in 
said storing means, while choosing from said storing means a still picture corresponding 
to a thumbnail image chosen by said selection means and displaying it. A storing means 
to be the image processing system which reproduces a still picture and/or an animation, 
and to store an animation corresponding to one of still pictures among a thumbnail 
image corresponding to at least one or more still pictures and the still picture concerned, 
and the still picture concerned A display means which indicates said thumbnail image 
by list A selection means to choose any one of thumbnail images displayed on said 
display means 

[Claim 20] A thumbnail image corresponding to at least one or more still pictures which 
said storing means stores, and the still picture concerned, And each animation 
corresponding to one of still pictures is compressed among the still pictures concerned. 
It is the image processing system according to claim 19 which is further equipped with 
an expanding means to elongate a compressed still picture, a compressed thumbnail 
image, and a compressed animation, and is characterized by said display means 
displaying at least one or more of an elongated still picture, a thumbnail image, and 
animations. 

[Claim 21] It is the image processing system according to claim 19 or 20 characterized 
by what said display means adds a mark to said thumbnail image when an animation 
corresponding to a still picture corresponding to a thumbnail image displayed on said 
display means exists in said storing means, and is displayed. 

[Claim 22] It is an image processing system given in claim 19 which is equipped with a 
thumbnail image creation means create a thumbnail image of a predetermined frame of 
said animation further when an animation corresponding to a still picture 
corresponding to a thumbnail image displayed on said display means exists in said 
storing means, and is characterized by for said display means to display a thumbnail 
image created by said thumbnail creation means with said thumbnail image, said still 
picture, and said animation thru/or any 1 term of 21. 

[Claim 23] Furthermore, said display means is an image processing system given in 
claim 19 characterized by carrying out the enlarged display of said still picture when an 
animation corresponding to a still picture corresponding to a thumbnail image chosen 
by said selection means is not stored in said storing means thru/or any 1 term of 22. 
[Claim 24] An image processing system given in claim 19 thru/or any 1 term of 23 
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characterized by providing the following. Furthermore, a deletion directions means to 
direct whether to delete an animation corresponding to a still picture corresponding to a 
thumbnail image chosen by said selection means, and the still picture concerned, or 
delete only the animation concerned A deletion means to delete only an animation 
corresponding to a still picture corresponding to a thumbnail image chosen by said 
selection means, and the still picture concerned, or the animation concerned based on 
directions by said deletion directions means 

[Claim 25] An image-processing method characterized by providing the following. An 
input process which inputs dynamic-image data constituted with a continuous frame 
image A directions process which directs said desired frame image from dynamic-image 
data inputted at said input process A thumbnail image generation process which 
generates a thumbnail image of said frame image directed at said directions process A 
storing process which associates said dynamic-image data, image data of a frame image 
directed at said directions process, and image data of a thumbnail image generated at 
said thumbnail image generation process, respectively, and stores them 
[Claim 26] Furthermore, an image -processing method according to claim 25 which is 
equipped with an animation pressing operation which compresses each frame of said 
dynamic-image data, and is characterized by storing compressed data for every frame 
based on said animation pressing operation at said storing process. 
[Claim 27] Furthermore, an image-processing method according to claim 25 which is 
equipped with an animation cutback pressing operation which reduces size of each 
frame of said dynamic-image data, and compresses to each reduced frame, and is 
characterized by storing compressed data for every frame based on said animation 
cutback pressing operation at said storing process. 

[Claim 28] Furthermore, an image-processing method given in claim 25 characterized 
by having a still picture pressing operation which compresses image data of a frame 
image directed at said directions process, and image data of said thumbnail image 
thru/or any 1 term of 27. 

[Claim 29] Furthermore, an image -processing method according to claim 25 
characterized by having the 2nd file creation process which creates a file of image data 
of a frame image directed at the 1st file creation process and said directions process 
which creates a file of said dynamic-image data, and image data of said thumbnail 
image. 

[Claim 30] An image-processing method according to claim 29 characterized by relating 
by attaching the same file name to a file of an animation created at said 1st file creation 
process, and a file of a still picture created at said 2nd file creation process at said 1st 
file creation process and said 2nd file creation process. 

[Claim 31] Furthermore, an image -processing method according to claim 29 or 30 
characterized by relating by adding information which specifies a frame image used for 
creating the thumbnail image concerned at said 2nd file creation process to a file of a 
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thumbnail image created at said 2nd file creation process. 
[Claim 32] Furthermore, the image -processing method according to claim 29 
characterized by to associate the file which was equipped with a management 
file-creation process which creates a file created at said 1st file-creation process, and a 
management file which described relation with a file created at said 2nd file-creation 
process, and was created by said management file at said 1st file-creation process, and 
the file created at said 2nd file -creation process. 

[Claim 33] Furthermore, an image -processing method according to claim 29 
characterized by having a multiplexing process which multiplexes a file created at said 
1st file creation process, and a file created at said 2nd file creation process, and is made 
one file. 

[Claim 34] An image -processing method which is equipped with the following, and is 
characterized by carrying out the repeat display of the animation concerned when an 
animation corresponding to the still picture concerned is stored in said storing means, 
while choosing firom said storing means a still picture corresponding to a thumbnail 
image chosen at said selection process and expressing it as said display process. A 
storing process which is the image -processing method which reproduces a still picture 
and/or an animation, and stores an animation corresponding to one of still pictures in a 
predetermined storing means among a thumbnail image corresponding to at least one 
or more still pictures and the still picture concerned, and the still picture concerned A 
display process which indicates said thumbnail image by list A selection process which 
chooses any one of thumbnail images displayed at said display process 
[Claim 35] A thumbnail image corresponding to at least one or more still pictures which 
said storing means stores, and the still picture concerned, And each animation 
corresponding to one of still pictures is compressed among the still pictures concerned. 
An image -processing method according to claim 34 which is further equipped with an 
expanding process which elongates a compressed still picture, a compressed thumbnail 
image, and a compressed animation, and is characterized by displaying at least one or 
more of an elongated still picture, a thumbnail image, and animations at said display 
process. 

[Claim 36] An image -processing method according to claim 34 or 35 which is further 
equipped with a thumbnail image creation process which creates a thumbnail image of 
a predetermined firame of said animation, and is characterized by displaying a 
thumbnail image created at said thumbnail creation process with said thumbnail image, 
said still picture, and said animation at said display process when an animation 
corresponding to a still picture corresponding to a thumbnail image displayed at said 
display process exists in said storing means. 

[Claim 37] An image-processing method given in claim 34 thru/or any 1 term of 36 
characterized by providing the following. Furthermore, a deletion directions process of 
directing whether deleting an animation corresponding to a still picture corresponding 
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to a thumbnail image chosen at said selection process, and the still picture concerned, or 
delete only the animation concerned A deletion process which deletes only an animation 
corresponding to a still picture corresponding to a thumbnail image chosen at said 
selection process, and the still picture concerned, or the animation concerned based on 
directions at said deletion directions process 

[Claim 38] A program which performs an image-processing method of a publication in 
claim 25 thru/or any 1 term of 37. 

[Claim 39] A program according to claim 38 is stored and it is the storage which a 
computer can read. 



DETAILED DESCRIPTION 



[Detailed Description of the Invention] 
[0001] 

[The technical field to which invention belongs] This invention relates to a program and 
a storage at the image processing system which photos an animation or reproduces a 
still picture and/or an animation and the image-processing method, . and a list. 
[0002] 

[Description of the Prior Art] In the digital camera which photos a still picture, the 
animation photography function using a Motion- JPEG format is beginning to be carried. 
Moreover, also in a digital camcorder, a model with the function in which still picture 
photography can be performed to the timing of arbitration during animation 
photography is also in a part. By using the camera which carried these functions, 
according to a photography scene or the object, still picture photography and animation 
photography can be used properly, and a user can choose the photography data format 
according to liking. 
[0003] 

[Problem(s) to be Solved by the Invention] However, the photography function in a 
digital camera cannot be photoed after opting for either still picture photography or 
animation photography uniquely, and it cannot record a still picture and an animation 
simultaneously. Moreover, semiconductor memory cards, such as a CompactFlash 
(registered trademark) card (it is called CF card below) and the SmartMedia card (it is 
called SM card below), are main, the archive medium currently used with the digital 
camera has a limitation also in storage capacity, and its commercial price is not cheap, 
either. Therefore, it is difi&cult to record record of prolonged data, and two or more video 
datas in the animation photography by Motion- JPEG. 

[0004] Moreover, during the animation photography which continued in the digital 
camcorder, although still picture photography is possible to arbitration, a video data is 
recorded on it as stream data to tape media, and still picture data is saved at a tape top 
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or another archive medium. When a still picture is recorded on a tape, there is a 
problem that an animation breaks off and only the time zone of still picture record is 
recorded. Moreover, since the archive medium is divided when saved at another archive 
medium, there is a defect of being hard to take a response of an animation and a still 
picture later. 

[0005] It aims at offering the image processing system which this invention is 
accomplished in view of the above problem, photos the animation for several frames 
before and after a still picture and this still picture, and associates and holds the still 
picture and animation which were photoed, and its method. 

[0006] Moreover, this invention aims at offering the image processing system and the 
image-processing inethod of carrying out the repeat display of the animation of several 
frames before and after the photoed still picture and this still picture further. 
[0007] 

[Means for Solving the Problem] In order to attain the object of this invention, an image 
processing system of this invention is equipped with the following configurations. 
[0008] Namely, an input means to input dynamic-image data constituted with a 
continuous frame image, A directions means to direct said desired frame image from 
dynamic-image data inputted by said input means, A thumbnail image generation 
means to generate a thumbnail image of said frame image directed by said directions 
means, An image processing system characterized by having a storing means to 
associate said dynamic"image data, image data of a frame image directed by said 
directions means, and image data of a thumbnail image generated by said thumbnail 
image generation means, respectively, and to store them. 

[0009] In order to attain the object of this invention, an image processing system of this 
invention is equipped with the following configurations. 

[00 10] Namely, it is the image processing system which reproduces a still picture and/or 
an animation. A storing means to store an animation corresponding to one of still 
pictures among a thumbnail image corresponding to at least one or more still pictures 
and the still picture concerned, and the still picture concerned, It has a display means 
which indicates said thumbnail image by list, and a selection means to choose any one of 
thumbnail images displayed on said display means. Said display means An image 
processing system characterized by carrying out the repeat display of the animation 
concerned when an animation corresponding to the still picture concerned is stored in 
said storing means, while choosing from said storing means a still picture corresponding 
to a thumbnail image chosen by said selection means and displaying it. 
[0011] 

[Embodiment of the Invention] With reference to an accompanying drawing, this 
invention is explained to details according to a suitable operation gestalt below. 
[0012] In a [operation gestalt of** 1st] book operation gestalt, the camera module which 
can photo a still picture and an animation is carried, and a static image explains JPEG 
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compression and a dynamic image about an image processing system storable as 
MPEG4 compressed data by the photoed data. 

[0013] Drawing 1 is the block diagram showing the basic configuration of the image 
processing system in this operation gestalt. In this drawing, 101 is CPU (arithmetic and 
program controD, and actuation of this image processing system is controlled by this 
CPU 101. DC to DC converter 115 for supplying ROM (read only memory) 106 and RAM 
(random access memory) 107 which have memorized the still picture codec section 102, 
the animation codec section 103, the image-processing section 104, and the 
below-mentioned control program, the data storage section 108, the tablet control 
section 109, the LCD control section 111, a shutter SW113, the control key group 114, 
and a power supply, and the timer 117 are connected to CPUlOl, respectively. 
[0014] And in the image processing section 104, the display (the display screen and its 
actuators, such as a TFT electrochromatic display) 112 is connected to the handwriting 
tablet 110 and the LCD control section 111 at the camera section 105 and the tablet 
control section 109. Moreover, the power supply is supplied to DC to DC converter 115 
from the cell 116. The display 112 and the handwriting tablet 110 have integral 
construction to which the laminating of the transparence tablet 110 was carried out in 
the upper part of a display 1 12, and it has come to be able to perform the various 
below-mentioned control operation by carrying out pen touch of the corresponding 
location, referring to the graphical data currently displayed on the display 112. 
[0015] CPUlOl performs various control based on the control program in ROM106. The 
following is contained in these control. 

[0016] - Read the photography picture signal of the animation and still picture which 
were outputted firom the image -processing section 104. From the processing and 
RAM107 which performs a DMA transfer to RAM107, to the LCD control section An 
animation, And the image data sent &om the processing and the image-processing 
section 104 which carries out the DMA transfer of the data of a still picture is 
JPEG-compressed or MPEG compression processed. The processing and JPEG 
compression stored in the data storage section 104 by file format, In order to perform 
MPEG compression processing The still picture codec section 102 and the animation 
codec section 103 Are based on control lead by the control key group 115 under 
directions and application activation of the photography actuation accompanying 
actuation of the activation and the shutter SW114 of various applications in which the 
information inputted from processing / handwriting tablet 110 to drive was followed. 
The control signal for controlling supply of the power supply to corresponding activation 
and each element of control processing The processing outputted to DC-DC converter 
117 and RAM107 are equipped with evacuation area 107e image expansion area 107a, 
work area 107b, VRAM107c, and animation buffer 107d and temporarily. Image 
expansion area 107a is used as the temporary buffer for storing temporarily a part of 
JPEG compression image data by which reading appearance was carried out firom the 



8/21 



Japanese Publication number : 2003-092724 A 



photography image (YUV digital signal) sent more nearly continuously than the 
image-processing section 104 or the data storage section 108, and MPEG compression 
image data, or a work area only for images for picture compression processing and 
extension processing. Work area 107b is a work area for various programs, and the 
various application programs performed by CPU 101 use it. VRAMlOTc is used as a 
VRAM which stores the indicative data displayed on a display 112. Animation buffer 
107d is a field which stores temporarily the firame data in which animation compression 
was carried out by the animation codec section 103 by predetermined time. Moreover, 
evacuation area 107e is the area for evacuating various data temporarily temporarily. 
[0017] The data storage section 108 is used as a field for being used as image data 
storage area 108a, and storing files, such as photography still picture data by which 
JPEG compression was carried out and a photography video data by which MPEG 
compression was carried out, and various attached data further referred to from 
appUcation, a folder, etc. Although a flash memory consists of these operation gestalten 
as the data storage section 108, it is not limited to this. 

[0018] The camera section 105 contains a lens group, CCD, the CCD control section, etc. 
In order that a lens group may project a photographic subject image to CCD optically, it 
consists of two or more lenses, and CCD (optoelectric transducer) is an element for 
changing into an analog electrical signal the photography image projected by the lens 
group. Moreover, the CCD control section includes the circuit for performing the timing 
generator for supplying a transfer clock signal and a shutter signal to CCD, noise 
rejection of a CCD output signal, and gain processing, the A/D" conversion circuit for 
changing an analog signal into a 10-bit digital signal further, etc. 

[0019] Moreover, the image-processing section 104 performs image processings, such as 
gamma conversion, a color space conversion and a white balance, AE, and flash plate 
amendment, for the 10-bit digital signal outputted firom the camera section 105, and 
performs the 8-bit each digital signal output of a YUV (4:2:2) format or a YUV (4:2:0) 
format. 

[0020] The still picture codec section 102 performs JPEG compression processing to the 
still picture data (YUV digital image data) obtained by the camera section 105 and the 
image-processing section 104. The JPEG encoder for creating JPEG still picture data 
(the created still picture data is stored in image data storage area 108a of the data 
storage section 108), JPEG encoding is carried out by this still picture codec section 102, 
and the JPEG decoder for changing into YUV digital stiU picture data the still picture 
data stored in the data storage section 108 by reception and JPEG extension processing 
is included. 

[0021] Moreover, the animation codec section 103 performs MPEG compression 
processing to the video data (YUV digital image data) obtained by the camera section 
105 and the image-processing section 104. The MPEG encoder for creating an MPEG 
video data (the created video data is stored in image data storage area 108a of the data 
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storage section 108), MPEG encoding is carried out by this animation codec section 103, 
and the MPEG decoder for changing into a YUV digital video data the video data stored 
in the data storage section 108 by reception and MPEG extension processing is included. 
[00221 The tablet control section 109 performs control for changing into a digital signal 
the various information inputted by actuation control of the handwriting tablet 110 and 
pen touch from the handwriting tablet 110, and transmitting to CPUlOl. 
[0023] The LCD control section 111 performs processing outputted to a display 112, or 
processing which outputs similarly the RGB digital data stored in VRAM 107c to a 
display 112, after changing into reception and a RGB digital signal the YUV digital 
image, data transmitted from the image-processing section 104, or the YUV digital 
image data which performed JPEG and MPEG extension to the image file in the data 
storage section 108. A display 112 is an indicator for displaying an image, and the 
output of the GUI screen at the time of appUcation actuation etc. is performed to the 
repeat display of the data of the still picture with which the monitor image of a 
photography image was outputted or photoed, and an animation, and a pan as an 
electronic view finder at the time of photography. This display is taken as VGA 
specification (640x480 dots) TFT-Uquid-crystal display with this operation gestalt. 
[0024] A shutter SW113 is a shutter for directing initiation of photography actuation. 
There are two steps of switch positions, it is the 1st step of detection of a position (it is 
called a "half-push position" below weak ****** -), lock actuation of camera setting out, 
such as a white balance and AE, is performed by ****** of a switch, this shutter SW113 
is the 2nd step of detection of a position (it is called a "shutter-on position" below strong 
****** •), and photography is performed. 

[0025] Without limiting the operation under application activation to a pen input from a 
tablet, the control key group 114 is the auxiliary key which enabled it to control an easy 
fiinction, for example, contains the cursor key, the scrolling key, the decision key, the 
cancel key, etc. 

[0026] A cell 116 is the rechargeable battery or dry cell of a RICHA tea bull. Moreover, 
DC to DC converter 115 receives the current supply from a cell 116, makes two or more 
power supplies by performing pressure up and a regulation, and supplies the power 
supply of voltage required for each element which makes CPU 101 the start. This DC to 
DC converter 115 can control initiation of supply of each voltage, and a halt by the 
control signal from CPU 101. 

[0027] A deadline signal will be told to CPU 101, if a timer 117 becomes the timer value 
which was a thing, and the timer count started and was set when it started after setting 
a timer value in order to measure animation exposure time. 

[0028] It explains hereafter using the flow chart of this place which shows actuation of 
the image processing system in this operation gestalt equipped with the above 
configuration to drawing 2 . Drawing 2 is the flow chart of the processing of Maine 
which the image processing system in this operation gestalt performs. 
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[0029] In this drawing, if the power supply of a main part is switched on at step S201, in 
step S202, the current mode will check that it is a playback mode. In the case of a 
playback mode, processing is shifted to step S203 and regeneration of the static image 
stored in the main part and dynamic image data is performed in step S203 here. About 
the details of this regeneration, it mentions later. Moreover, in not being a playback 
mode in step S202, it shifts processing to step S204, and in step S204, photography 
processing of the static image by the built-in camera module and a dynamic image is 
performed. Also about the details of this photography processing, it mentions later. 
Moreover, in not being in photography mode in step S204, it shifts processing to step 
S206, and other processings are performed in step S206. Other processings are 
administrative applications, such as system construction of for example, the main part 
of an image processing system, and configuration, etc. 

[0030] Termination of each processing of steps S203, S205, and S206 confirms whether 
power supply OFF actuation was performed in step S207. When power supply OFF 
actuation is performed, power supply OFF processing is performed in step S208. 
Moreover, in not being power supply OFF actuation, it is regarded as that by which 
mode change actuation is performed, and returns to check processing of being the 
playback mode of step S202 again. 

[0031] Next, detailed explanation of the still picture in the above-mentioned step S203 
and animation regeneration is hereafter explained using drawing 3 . Drawing 3 is a flow 
chart showing the details of the processing in step S203. 

[0032] Weight is carried out until it performs the list display of the thumbnail image 
data corresponding to the various still pictures first stored in the data storage section 
108 at step S301 and actuation by the operator is performed in this drawing. This 
thumbnail image data is data created to static-image data by performing cutback 
processing to thumbnail size (80x60dot), and carrying out JPEG compression. The 
details about the example of a display are mentioned later. 

[0033] Selection actuation of the image by the operator can be specified by pen actuation 
to the tablet 110 which is united with the display 112, or the focal migration and the 
decision key by actuation of the four- directions cursor key contained in the control key 
group 114 can perform it. Here, in step S302, when a thumbnail image is chosen, in step 
S303, it is confirmed whether the video data corresponding to the selected thumbnail 
image exists. The details about this check method are mentioned later. When the 
dynamic image exists, processing is shifted to step S304. 

[0034] In step S304, JPEG extension processing of the stiU picture data by which read 
the still picture data corresponding to the thumbnail image chosen first firom the data 
storage section 108, and reading appearance was carried out is carried out by the still 
picture codec section 102, and the elongated still picture data is displayed after 
performing cutback processing in QVGA size (320x240dot). Animation regeneration is 
performed, after reading the video data corresponding to the static image by which it 
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was indicated by selection from the data storage section 108, performing MPEG 
extension processing by the animation codec section 103 and performing cutback 
processing in QQVGA size (I60xl20dot) further in step S305 furthermore. That is, a 
still picture display and an animation repeat display are simultaneously performed on 
one screen. The details about these examples of a display are also mentioned later. 
[0035] Here, in step S306, when the still picture data currently displayed is directed by 
pen actuation or cursor key actuation, processing is shifted to step S307. A display is 
performed on the whole screen in VGA size in this still picture data by step S307. 
Moreover, when the video data currently reproduced is similarly directed in step S308, 
a repeat display is too performed on the whole screen in VGA size in a video data. And 
in step S3 10, if pen touch of this screen is carried out in the state of the repeat display in 
steps S307 and S308, it will return to processing of the simultaneous playback screen of 
the still picture after step S304 and an animation. again. Moreover, in step S3 11, when 
the directions "return" by pen touch actuation etc. are made, it returns to the list 
display of the thumbnail image data of step 8301 again. 

[0036] Moreover, in step S303, when the video data corresponding to the selecte;d image 
does not exist, in step S3 12, the still picture data corresponding to the selected image is 
read from the data storage section 108, JPEG extension processing by the still picture 
codec section 102 is performed, and a display is performed on the whole screen in VGA 
size (640x480dot) in the elongated still picture data. And if pen touch of this screen is 
carried out, it will return to the list display of the thumbnail image data of step S301 
again. 

[0037] Moreover, in step S302, when selection of an image is not performed, when pen 
touch of deletion actuation, i.e., the below-mentioned deletion carbon button icon, is 
performed, in step 8314, deletion of image data is performed in step 8315. 
[0038] Next, detailed explanation of photography processing of the still picture in the 
above-mentioned step 8205 and an animation is explained below using drawing 4 . 
Drawing 4 is a flow chart showing the details of the processing in step 8205. 
[0039] In this drawing, at step S401, it checks first that it is animation photography 
mode, and, in the case of animation photography mode, progresses to the animation 
photography processing after step 8402. Moreover, in not being in animation 
photography mode, it progresses to the still picture photography processing after step 
8416 in the usual still picture photography mode. Here, animation photography mode is 
a mode of operation which photos the animation for time amount of the arbitration of 
order simultaneously, and records it at the time of photography (capture) of a stiU 
picture. 

[0040] In animation photography processing, processing which first incorporates the 
YUV digital image data for one frame outputted through the image-processing section 
104 from the camera section 105 to image expansion area 107a of RAM 107 in step 8402 
is performed. Next, in step 8403, when it checks that it is that whether capture 
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directions having been made and a shutter SW113 that is, were pushed (a shutter 
SW113 is the condition of a shutter-on position) and capture directions are made here, it 
progresses to the processing after step S406. Moreover, when there are no capture 
directions, in step S404, the data for one frame with which MPEG compression of the 
MPEG compression processing was performed and carried out by the animation codec 
section 103 is temporarily stored in animation buffer 107d in step S405 to the image 
data for one frame incorporated at step S402. Animation buffer 107d, whenever it is a 
ring buffer and the MPEG compressed data of a new firanie is created, a sequential 
addition is carried out in the last location of a buffer, and if a buffer fills, it is thrown 
away from old firame data. Size of a buffer can be made adjustable at arbitration 
according to setting out of the animation record time. 

[0041] Moreover, in step S403, when capture directions are made, in step S406, JPEG 
compression processing is performed by the still picture codec section 102 to the image 
data for one frame incorporated by the still picture capture processing S402, i.e., a step. 
Next, in step S407, a timer value (animation exposure time) is set to a timer 117 for 
time amount measurement, and processing which starts a timer 117 is performed. 
Although especially the setting-out method of this timer value is not limited, that value 
is made to fluctuate using the cursor key of "right and left" included in the control key 
group 114 (the value made to fluctuate is displayed on the display 112), and you may set 
up by carrying out the depression of the decision key. 

[0042] At step S408, processing which incorporates the YUV digital image data for one 
frame outputted through the image-processing section 104 from the camera section 105 
to image expansion area 107a of RAM 107 like step S402 is performed. Furthermore in 
step S409, MPEG compression processing is performed by the animation codec section 
103 like step S404 to the image data for one frame incorporated at step S408. In step 
S410, additional storing of the data for one frame by which MPEG compression was 
carried out is carried out to the animation buffer 107d tail end. And in step S411, when 
confirming whether the timer 117 started at step S407 passed the deadline of and 
having not passed the deadline of yet (i.e., when animation exposure time still remains), 
MPEG compression processing of return and frame data is again repeated to step S408. 
[0043] When a timer 117 passes the deadline of in step S411, in step S412, data, such as 
a predetermined JPEG header, is first added to the data by which JPEG compression 
was carried out at step S406, and processing saved as a JPEG file at image data storage 
area 108a is performed. Simultaneously, cutback processing is performed to the 
captured still picture data, the thumbnail data based on JPEG compression processing 
is further created in step S413, and it saves as a JPEG file similarly at image data 
storage area 108a. Next, in step S414, to the MPEG compressed data of the multiple 
frame stored in steps S405 and S410, data, such as a predetermined MPEG header, is 
added and processing which saves like image data storage area 108a as an MPEG file is 
performed. These JPEG files and an MPEG file are the same file names, and an 
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extension is saved as ".JPG" and ".MP4", respectively. It will be related and created by 
theisame file name by the flow of the above processings as a JPEG still picture file and 
an MPEG animation file of the time amount of the arbitration before and behind that. 
[0044] Moreover, the information on the file name of the still picture data used for 
creating is added to thumbnail data (processing in step S413). If a thumbnail image is 
chosen in step S303 by doing in this way, since the file name of still picture data 
(dynamic-image data) can be specified by referring to the information added to the data 
of the selected thumbnail image, it can be confirmed whether the video data which has 
the same file name as the specified file name exists. Still picture data and the video data 
which correspond firom thumbnail data are specified hereafter, or in case the existence 
is checked, it carries out by doing in this way. 

[0045] And in step S415, when termination actuation by the operator is performed, 
photography processing is ended (when the icon "which returns to the Maine screen" is 
prepared, for example in a screen and pen touch of this icon is carried out). When 
termination actuation is not performed, reading processing of return and frame data is 
started again to step S402. 

[0046] On the other hand, when it is not in animation photography mode in step S401, 
in step S416, processing which outputs continuously the YUV digital image data 
outputted through the image-processing section 104 firom the camera section 105 to a 
display 112 is performed, and it becomes the value monitor of the image for 
photography by the electronic view finder. Here, in step S417, when it checks that it is 
that whether capture directions having been made and a shutter SW 113 that is, were 
pushed (a shutter SW113 is the condition of a shutter-on position) and capture 
directions are made here, still picture capture processing is performed in step S418. 
That is, when a shutter SW113 is pushed, processing which stores in image expansion 
area 107a of RAM107 the image data of one firame currently displayed on the display 
112 is performed. Next, in step S419, JPEG compression processing is performed by the 
still picture codec section 102 to the one-firame image data stored in image expansion 
area 107a. In step S420, the data for one frame by which JPEG compression was carried 
out is created as a JPEG file as above-mentioned, and is stored in the image data 
storage section 108. And in step S421, cutback processing is performed to the captured 
still picture data, the thumbnail data based on JPEG compression processing is created 
further, and it saves as a JPEG file similarly at image data storage area 108a. At this 
time, the information on the file name of still picture data is attached to thumbnail data. 
And in step S422, when termination actuation by the operator is performed, 
photography processing is ended. When termination actuation is not performed, the 
monitor processing by return and the electronic view finder is started again to step S416. 
[0047] Drawing 5 is drawing showing the example of a screen display of a list display of 
the thumbnail image data in step S301. The screen shown in this drawing is displayed 
on a display 112. This thumbnail image data is a thumbnail static image corresponding 
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to the various still pictures stored in the data storage section 108, and is the JPEG 
compressed data of the cutback image of 80x60dot. Moreover, as explained using 
drawing 4 , simultaneous creation of these is carried out in process of still picture 
photography processing, and they are stored in the data storage section 108. 
[0048] In this drawing, 501 is the list viewing area of a thumbnail image, and the 
thumbnail still picture data to each static-image data arranges in the shape of a grid in 
order of the created time (not limited to this sequence), and is displayed. In this viewing 
area, 502 is the field where the thumbnail image data to still picture data with a video 
data (the dynamic-image data of the same file name exists although extensions differ) is 
displayed, and the mark 504 which shows that an object image has a video data is 
displayed in piles. However, the method of showing a still picture with a dynamic image 
is not limited to the method by the mark shown in this drawing. 

[0049] Moreover, 503 is a field where the thumbnail image data to the data of only still 
picture data is displayed, and since the object image does not have a video data, a mark 
display is not performed. By seeing this mark display 504 whether displayed or not, an 
operator can judge easily whether it is still picture data in which the data corresponding 
to a thumbnail image has a video data. 

[0050] 505 is the focal display for expressing that it is in the condition that one of the 
thumbnail image data is specified. By operating the four- directions cursor key 
contained in the control key group 114, this focal display can be moved to the upper and 
lower sides and right and leffc at arbitration, and can choose the thumbnail image which 
the focus has hit by touching with a pen the thumbnail image field where the focus was 
hit and the depression or the focus has hit the decision key. Or even if it carries out the 
double touch of the field where the thumbnail image of the arbitration on the display 
screen is displayed with a pen, a thumbnail image can be chosen similarly. 
[0051] 506 and 507 are the portions showing the arrow head display which directs 
vertical scrolling, respectively, and when thumbnail image data cannot finish going into 
one screen, if they carry out pen touch of this arrow head, a thumbnail image list will 
scroll them top scrolling and the bottom. 

[0052] Moreover, 508 is a deletion carbon button icon. If pen touch of this icon is carried 
out, deletion of the image (image which the focus has hit) chosen will be performed. 
[0053] Next, the example of a screen display when the thumbnail image to still picture 
data with a video data is chosen as drawing 6 fi-om the thumbnail image list display 
shown in drawing 5 is expressed. The screen shown in drawing 6 is displayed on a 
display 112. 

[0054] After reading the staticimage data corresponding to the thumbnail image which 
601 is a still picture viewing area and was chosen and performing JPEG extension 
processing in this drawing, cutback processing is performed, and it displays on this field 
in QVGA size (320x240dot). Moreover, 602 is the field where the repeat display of the 
dynamic-image data corresponding to static-image data is performed, the target 
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dynamic-image data is read, after it performs MPEG extension processing, it performs 
cutback processing, and it performs an animation repeat display to this field 
continuously in QQVGA size (I60xl20dot). 

[0055] 603 is the viewing area of the icon "returning" and returns to the thumbnail Ust 
display of drawing 5 by carrying out pen touch of this icon. Moreover, 604 is the viewing 
area of a playback carbon button icon, and animation playback starts it by carrying out 
pen touch of this icon. Furthermore, 605 is the viewing area of an earth-switch icon, and 
animation playback stops it by canying out pen touch of this icon. 

[0056] In this screen, if pen touch of the still picture viewing area 601 is carried out, still 
picture data will be displayed to the limit [ VGA size (640x480dot) ] of a screen. 
Moreover, if pen touch of the animation display field 602 is carried out, the repeat 
display of the video data will be carried out in the animation size currently originally 
recorded. 

[0057] Although the digital data based on MPEG4 compression was mentioned as the 
example with this operation gestalt and it explained it as the digital data based on 
JPEG compression, and an animation as a still picture, even if it uses other stiU 
pictures, an animation compression method, or the data twisted incompressible, it 
cannot be overemphasized that the same effect is acquired. For example, as a still 
picture, MPEGl with compressibility higher than a still picture, MPEG 2 compressed 
data, etc. are contained as various formats, such as RGB bit map data, GIF compressed 
data, and GING compressed data, and an animation. 

[0058] Although this operation gestalt furthermore explained the case so that it may 
carry out by carrying out pen actuation of the handwriting tablet as operation for 
performing application, it may not be limited to this but the operation by the key stroke 
is sufficient. For example, actuation of assignment of a thumbnail image, selection, etc. 
changes the thumbnail image chosen by moving a focal firame by the four-directions 
cursor key, and a user interface which specifies the thumbnail image data further 
chosen by the decision key is also considered. 

[0059] [the 2nd operation gestalt] the MPEG compression with compressibility higher 
than JPEG was used for the 1st operation gestalt as JPEG compression and a 
compression method of a video data as a compression method of still picture data. 
However, in order to make small not the thing limited to this but the storing file size of 
a video data, not only the method of lowering image quality and gathering 
compressibiHty but the method of reducing the magnitude of an image is considered. 
With this operation gestalt, the number of pixels is operated on a curtailed schedule at 
the time of incorporation of firame data, and after performing cutback processing of an 
image, an operation gestalt which performs animation compression processing is 
explained. 

[0060] Drawing 7 is a flow chart showing the details of photography processing of the 
still picture in this operation gestalt and a video data. 



16/21 



Japanese Publication number : 2003-092724 A 



[OO6II In this drawing, steps S701, S702, and S703 are the same processings as steps 
S401, S402, and S403, respectively. And in step S703, when capture directions are made, 
it progresses to the processing after step S707. Moreover, when there are no capture 
directions, in step S704, to the image data for one frame incorporated at step S702, 
cutback processing is performed and processing changed into the image data of QQVGA 
size (I60xl20dot) is performed. And in step S705, JPEG compression processing is 
performed by the still picture codec section 102 to the reduced image data. The data for 
one frame by which JPEG compression was carried out is temporarily stored in 
animation buffer 107d in step S706. 

[0062] Moreover, in step S703, when capture directions are made, in step S707, JPEG 
compression processing is performed by the still picture codec section 102 to the image 
data for one frame incorporated by the still picture capture processing S702, i.e., a step. 
Next, in step S708, a timer value (animation exposure time) is set to a timer 117 for 
time amount measurement, and processing which starts a timer is performed. 
[0063] At step S709, processing which incorporates the YUV digital image data for one 
frame outputted through the image-processing section 104 from the camera section 105 
to image expansion area 107a of RAM107 like step S702 is performed. Furthermore, to 
the image data for one frame incorporated at step S709 as well as step S704 in step 
S710, cutback processing is performed and processing changed into the image data of 
QQVGA size (I60xl20dot) is performed. And in step S711, to the reduced image data, 
JPEG compression processing is performed by the still picture codec section 103, and 
additional storing of the data for one frame by which JPEG compression was carried out 
is carried out in step S712 to the animation buffer 107d tail end. And in step S713, when 
confirming whether the timer 117 started at step S708 passed the deadline of and 
having not passed the deadline of yet (i.e., when animation exposure time still remains), 
JPEG compression processing of return and frame data is again repeated to step S709. 
[0064] When a timer 117 passes the deadline of in step S713, in step S7 14, data, such as 
a predetermined JPEG header, is first added to the data by which JPEG compression 
was carried out at step S707, and processing saved as a JPEG file at image data storage 
area 108a is performed. Cutback processing is performed to the still picture data 
captured simultaneously, the thumbnail data based on JPEG compression processing is 
fiirther created in step S715, and it is saved similarly at image data storage area 108a. 
Next, in step S716, to the JPEG compressed data of the multiple frame stored in steps 
S706 and S712, the data about a predetermined JPEG header and a predetermined file 
format etc. is added, and processing which saves like image data storage area 108a as a 
Motion- JPEG (it is called M-JPEG below) file is performed. These JPEG files and a 
M-JPEG file are the same file names, and an extension is saved as ".JPG" and ".MJPG", 
respectively. It will be related and created by the same file name by the flow of the 
above processings as one JPEG still picture file and a M-JPEG animation file of the 
time amount of the arbitration before and behind that. 
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[0065] Moreover, the information on the file name of the still picture data used for 
creating this data is added to thumbnail data like the 1st operation gestalt. If 
thumbnail data is chosen by doing in this way, since the file name of dynamic-image 
data can be specified by referring to the information added to selected thumbnail data, 
it can be confirmed whether the video data which has the same file name as the 
specified file name exists. 

[0066] And in step S717, like step S415, when termination actuation by the operator is 
performed, photography processing is ended. When termination actuation is not 
performed, reading processing of return and firame data is started again to step S702. 
[0067] In the check in the animation photography mode of step S701, when it is not in 
animation photography mode, the usual still picture photography processing is 
performed in step S718. The content of processing is the same processing as steps 
S416-S422. 

[0068] A [operation gestalt of ** 3rd] book operation gestalt explains processing 
(processing in step S3 15) when a deletion icon is operated. 

[0069] Drawing 8 is a flow chart showing the details of the deletion in step S3 15. In this 
drawing, it is confirmed at step S801 whether a video data exists to the thumbnail data 
by which deletion assignment was carried out. As the 1st operation gestalt also 
explained as a method of checking, it is confirmed whether, with reference to the 
information added to the specified thumbnail data, the dynamic-image data of the file 
name which specified and specified the file name exists. 

[0070] When a video data exists, the selection-menu display of Delete mode is performed 
in step S802. This Delete mode is the two modes, "all Delete modes" which deletes all of 
a video data and still picture data, and "animation Delete mode" which deletes only a 
video data, and a menu indication of these modes is given. Here, in step S803, when all 
Delete modes are chosen, in step S804, the animation data file corresponding to the 
thumbnail data specified first is read, and the deletion is performed. Then, in step S805, 
the still picture data file (an extension is the file of .JPG at the same file name) related 
with the video data is read, and the deletion is performed. Moreover, the information 
added to the thumbnail data corresponding to the video data and still picture data 
which were deleted is deleted similarly, and processing ends it. 

[0071] In step 8803, when it is checked and chosen whether animation Delete mode was 
chosen in step S806 when aU Delete modes were not chosen, in step S807, deletion of an 
animation data file is performed like step S804, and processing is ended. Moreover, in 
step S806, when it confirms whether deletion cancellation actuation was performed in 
step S808 when animation Delete mode was not chosen and cancellation actuation is 
performed, deletion is ended, and when not carried out, it returns to the actuation 
action waiting by the operator again. Moreover, in step S801, when a video data does 
not exist, in step S805, a still picture data file is read, and the deletion is performed and 
it ends. 
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[0072] [the 4th operation gestalt] with the operation gestalt of the 1st thru/or 3, a list 
indication only of the thumbnail image to still picture data was only given in the list 
display of thumbnail image data shown by drawing 5 . 

[0073] This operation gestalt explains an operation gestalt by which a list indication of 
the thumbnail image of the predetermined frame of still picture data and a video data is 
given simultaneously in a thumbnail image list display. 

[0074] Drawing 9 is drawing showing the example of a screen display of a list display of 
thumbnail image data by this operation gestalt. As it is a thumbnail image 
corresponding to the various still pictures stored in the data storage section 108, and a 
thumbnail image corresponding to an animation and being explained in drawing 4 , 
simultaneous creation of this thumbnail still picture data is carried out in process of 
still picture photography processing, and it is stored in the data storage section 108, 
Moreover, about animation thumbnail data, after reading the video data stored in the 
data storage section 108 in the case of a thumbnail display and performing cutback 
processing in thumbnail size to a predetermined frame at it, it is displaying as still 
picture thumbnail data. 

[0075] In drawing 9 , 901 is the list viewing area of a thumbnail image, is arranged in in 
the shape of a grid in order of the time by which static-image data or a video data was 
created, and is displayed. In this viewing area, 902 is a portion as which the thumbnail 
data to still picture data is displayed, and is the thumbnail size of 120x90dot. Moreover, 
903 and 904 are portions as which the thumbnail data to a video data is displayed, and 
thumbnail data [ as opposed to the head frame of an animation in 903 1 and 904 show 
the thumbnail data to the last frame of an animation. However, not the thing limited to 
this but the thumbnail data to the frame of arbitration is sufficient. The thumbnail data 
to this animation serves as thumbnail size of 60x45dot. Moreover, 905 shows the field 
where only the still picture thumbnail is displayed, and it is shown in this data that the 
video data does not exist. 

[0076] 906 and 907 are the portions showing the arrow head display which directs 
vertical scrolling, respectively, and when thumbnail image data cannot finish going into 
one screen, if they carry out pen touch of this arrow head, a thumbnail image list will 
scroll them top scrolling and the bottom. 

[0077] Moreover, 908 is a deletion carbon button icon. If pen touch of this icon is carried 
out, deletion of the image chosen will be performed. 

[0078] [the 5th operation gestalt] - with the operation gestalt of the 1st thru/or 4, 
correlation of still picture data and a video data was performed by considering as the file 
which changed the extension in the same file name. However, about correlation between 
photography data, it is not limited to this, and can realize also by creating the 
management file which described the relation to the file saved by the respectively 
different name. The example of a configuration of this management file is shown in 
drawing 10 . It is shown that the file of the still picture data indicated by the companion 
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in this drawing and the file of a video data are related. Moreover, it cannot be 
overemphasized that a method which is saved at one file after multiplexing still picture 
data and a video data is also considered. 

[0079] Moreover, in thumbnail data, with the operation gestalt of the 1st thru/or 4, 
although the still picture data corresponding to selected thumbnail data and a video 
data were able to be specified by attaching the file name of still picture data and a video 
data, it is not limited to this. That is, this thumbnail data may be included in an 
above-mentioned management file, and each related attachment of thumbnail data, still 
picture data, and a video data may be performed. What is necessary is just to indicate 
the file name of a thumbnail image in the configuration of the management file 
specifically iDustrated to drawing 10 to the file of corresponding still picture data or the 
file of a video data, and a companion. Moreover, thumbnail data, still picture data, and 
a video data may be multiplexed to one file as above-mentioned. 

[0080] In addition, processing which multiplexes the above management file or 
thumbnail data, still picture data, and a video data to one file is performed by CPU 101. 
[0081] This invention is not limited only to the equipment and the method for realizing 
the above-mentioned operation gestalt, supplies the program code of the software for 
realizing the above-mentioned operation gestalt to the computer in the 
above-mentioned system or equipment (CPU or MPU), and also when the computer of 
the above-mentioned system or equipment operates the various above-mentioned 
devices according to this program code and it realizes the above-mentioned operation 
gestalt to a [gestalt of other operations] pan, it is contained in it under the category of 
this invention. 

[0082] Moreover, the program code of said software itself will realize the function of the 
above-mentioned operation gestalt in this case, and the means for supplying that 
program code itself and its program code to a computer and the storage which 
specifically stored the above-mentioned program code are contained under the category 
of this invention. 

[0083] As a storage which stores such a program code, a floppy (registered trademark) 
disk, a hard disk, an optical disk, a magneto-optic disk, CD-ROM, a magnetic tape, the 
memory card of a non-volatile, ROM, etc. can be used, for example. 

[0084] Moreover, not only when the function of the above-mentioned operation gestalt is 
realized, but when the above-mentioned computer controls various devices only 
according to the supplied program code, and the above-mentioned operation gestalt is 
realized in collaboration with OS (operating system) to which the above-mentioned 
program code is working on a computer, or other application software, this program 
code is contained under the category of this invention. 

[0085] Furthermore, after this suppUed program code is stored in the memory with 
which the functional expansion unit connected to the functional add-in board and the 
computer of a computer is equipped, a part or all of processing that CPU with which 
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that functional add-in board and a functional storing unit are equipped based on 
directions of that program code is actual performs, and also when the above-mentioned 
operation gestalt is realized by that processing, it is contained under the category of this 
invention. 
[0086] 

[Effect of the Invention] Since according to this invention the thumbnail image of a still 
picture (frame image) and said still picture and the dynamic image corresponding to 
said stiU picture can be associated, respectively and can be stored as explained above, 
said related dynamic image, said still picture, and a thumbnail image are reproducible 
in an instant. Moreover, the effect that the dynamic-image data for which it asks by said 
regeneration can be searched in an instant also does so. 
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[Brief Description of the Drawings] 

[Drawing ll It is the block diagram showing the basic configuration of the image 
processing system in the 1st operation gestalt of this invention. 

[Drawing 2l It is the flow chart of the processing of Maine which the image processing 
system in the 1st operation gestalt of this invention performs. 

[Drawing 3l It is the flow chart which shows the details of regeneration of the still 
picture in step S203, and an animation. 

[Drawing 4l It is the flow chart which shows the details of photography processing of the 
still picture in step S205 and an animation. 

[Drawing 5l It is drawing showing the example of a screen display of a list display of the 
thumbnail image data in step S301. 

[Drawing 6l It is drawing showing the example of a screen display when the thumbnail 
image to still picture data with a video data is chosen firom the thumbnail image list 
display shown in drawing 5 . 

[Drawing 7] It is a flow chart showing the details of photography processing of the still 

picture in the 2nd operation gestalt of this invention and a video data. 

[Drawing 8] It is a flow chart showing the details of the deletion in step S315. 

[Drawing 9l It is drawing showing the example of a screen display of a list display of the 

thumbnail image data in the 4th operation gestalt of this invention. 

[Drawing 10] It is drawing showing the configuration of the management file in the 5th 

operation gestalt of this invention. 
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